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16- (Deleted) 

17. (Deleted) 

18. (Deleted) 

19. (Melted) 

20. (Previously Amaeimded) Apparatus comprising: 

a decoder, responsive to an input signal comprising signals representing audio and 
embedded video synthesis command signals, that separates the command signals from the 
signals representing audio, and converts text signals found in said audio into phoneme 
signals, to develop thereby an audio signal stream and a first set of video synthesis 
command signals stream; 

a converter for generating a second set of video synthesis command signals from said 
phoneme signals; 

a speech synthesizer responsive to said audio signal stream for developing sound; 

and 

a video synthesizer responsive to said video synthesis command signals stream 
for developing images. 

21. (Previously Added) The apparatus of claim '20 where said converter is 
interposed between said decoder and said video synthesizer, merging said command 
signals separated from said input signal with said command signals generated by said 
converter, to form a single stream of input-signal-related command signals that is applied 
to said video synthesizer. 

22. (Previously Added) The apparatus of claim 21 where said converter 
generates additional command signals interposed between said input-signal-related 
command signals. 
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23. (Previously Added) The apparatus of claim 20 where said video synthesis 
command signals are FAPs, and said video synthesis command signals generated by said 
converter are FAPs. 



24. (Previously Added) The apparatus of claim 23 where said video synthesis 
command signals generated by said converter are members of the FAP t parameter. 

25. (Previously Added) The apparatus of claim 23 where said video synthesis 
command signals generated by said converter are members of the FAP 1 parameter or 
FAP3-68 parameters, inclusively. 

26. (Deleted) 

27. (Deleted) 
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36- (Deleted) 

37. (Deleted) 

38. (Deleted) 

39. (Deleted) 

40. (Deleted) 

41. (Previously Amended) A method comprising the steps of: 
receiving an input signal that comprises text signals representing audio and 

embedded video synthesis command signals; 

separating said input signal into an audio signal stream and a video synthesis 

command signals stream; 

converting said text signal stream into phonemes and synthesizing speech from 

said phonemes, and 

developing a plurality of additional command signals and interposing the 
additional command signals into said video synthesis command signals stream to form a 
combined command signals stream; and 

synthesizing at least one image from said video synthesis command signals 
stream with aid of a FAP -based face model; 

where said step of developing develops a set of said additional command signals 
between each pair of said command signals of said combined command signals stream, 
and said set of additional command signals interpolated between said pair of said 
command signals of said combined command signals stream; and 

where said interpolation is in accord with a function of order greater than 2. 

42. (Previously Amended) The method of claim 41 where said interpolation is 
in accord with a function of order 4. 
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43. (Deleted) 

44. (Deleted) 

45. (Deleted) 

46. (Deleted) 

47. (Deleted) 
43. (Deleted) 

49. (Deleted) 

50. (Deleted) 

51. (Deleted) 

52. (Previously Amended) Apparatus comprising 

a decoder/synthesize module that is responsive to an input stream that includes a 
text specification commingled with explicit FAP information, in the form of interspersed 
bookmarks, each conveying information about identity of a FAP and an ultimate state 
that the FAP reaches in accordance with a specified transition path, outputting a 
synthesized voice at a first output, and phonemes as well as said FAP information at a 
second output; 

a converter responsive to said second output for generating a sequence of facial 
animation parameters; 

face rendering module responsive to said converter; and 

a compositor, responsive to said synthesizer and to said face rendering module; 
where the transition path follows the equation / (t) = a x + (a - a s )t , where a x is 
amplitude measure at beginning of transition, a is specified in said bookmark, and / is 
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| time, ranging between 0 and 1, or a transition path that involves higher powers of / or e 

raised to power 

53. (Previously Amended) The apparatus of claim 52 where the transition path 
follows the equation /(f) * a, + (1 - e~' ){a -aj, where a s is amplitude measure at 

beginning of transition, a is specified in said bookmark, and t is time, ranging between 0 
and 1. 

54. (Previously Aurnemded) The apparatus of claim 52 where the transition path 
follows the equation / (/) = a s +- J^^ /2) , where a s is amplitude measure at 

beginning of transition, a is specified in said bookmark, FABdur is specified in said 
bookmark, 1 is a specified parameter, and / is time, ranging between 0 and 1 . 

55. (Previously Amended) The apparatus of claim 52 where the transition path 
follows the equation f(t) = a M + (2l y - 3/ 2 + 1) + (-2/ 3 + 3t 2 )a + (t* - 2t 2 + i)g f , where a, is 
amplitude measure at beginning of transition, a is specified in said bookmark, g s is a 
specified parameter, and / is time, ranging between 0 and 1. 

56. (Previously Amended) The apparatus of claim 52 where the FAP amplitude 
transition path follows the equation 

FAPAmpii) = startVal(2? - 3t 2 + 1) + FAPval(-2t* + 3/ 2 ) + startTan(t l - 2t 2 + 1) , where 
' ' t 

startVaU FAPval, and startTan, are specified constants. 

57. (Deleted) 

58. (Deleted) 

59. (Deleted) 
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60. (Deleted) 

61. (Deleted) 

62. (DeSeted) 

63. (Deleted) 

64. (Deleted) 

65. (Deleted) 

66. (Previously Amended) A method comprising the steps of: 

receiving an input that includes a text specification commingled with explicit FAP 
information in the form of interspersed bookmarks* each conveying information about 
identity of a FAP and an ultimate state that the FAP reaches in accordance with a 
specified transition path, outputting a synthesized voice at a first output, and phonemes as 
well as said FAP information at a second output 

generating a sequence of facial animation parameters from signals of said second 

output; 

rendering images from output signals developed by said step of generating; and 
combining said synthesized voice and said images; 

where the transition path follows the equation / (/) = a H + (a - a r )t > where a $ is 

amplitude measure at beginning of transition, a is specified in said bookmark, and / is 
time, ranging between 0 and 1, or a transition path that involves higher powers of / or e 
raised to power /, 

67. (Previously Amended) The method of claim 66 where the transition path 
follows the equation /(/) = a s <f ' )(a - a x ) 7 where a s is amplitude measure at 
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beginning of transition, a is specified in said bookmark, and / is time, ranging between 0 
and 1. 

68. (Previously Amended) The method of claim 66 where the transition path 

follows the equation /(/) = a, + (1 _ g -V^L/ 2)) > where a * is amplitude measure at 

beginning of transition, a is specified in said bookmark, FABdur is specified in said 
bookmark, 1 is a specified parameter, and t is time, ranging between 0 and 1 . 

69. (Previously Amended) The method of claim 66 where the transition path 
follows the equation /(/) = a M + (2/ 3 ~3/ 2 + 1> + (-2/ 3 +3/ 2 )a + (t 3 - 2t 2 +0& > w tere a 3 is 
amplitude measure at beginning of transition, a is specified in said bookmark, g M is a 
specified parameter, and t is time, ranging between 0 and 1, 

70. (Previously Amended) The method of claim 66 where the FAP amplitude 
transition path follows the equation 

FAPAmp(t) = startVal(2t* ~3t 2 + \) + FAPval(-2? +3r 2 ) + startTan(t* ~2t 2 -h 1), where 

' ' i 

startVal, FAPval, and startTan, are specified constants. 
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